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Abstract 

Background: Quality circles (QCs) are commonly used in primary health care in Europe to consider and improve 
standard practice over time. They represent a complex social intervention that occurs within the fast-changing 
system of primary health care. Numerous controlled trials, reviews, and studies have shown small but unpredictable 
positive effect sizes on behavior change. Although QCs seem to be effective, stakeholders have difficulty 
understanding how the results are achieved and in generalizing the results with confidence. They also lack 
understanding of the active components of QCs which result in changes in the behavior of health care 
professionals. This protocol for a realist synthesis will examine how configurations of components and the 
contextual features of QCs influence their performance. 

Methods/Design: Stakeholder interviews and a scoping search revealed the processes of QCs and helped to 
describe their core components and underlying theories. After clarifying their historical and geographical 
distribution, a purposive and systematic search was developed to identify relevant papers to answer the research 
questions, which are: understanding why, how, and when QCs work, over what time frame, and in what 
circumstances. After selecting and abstracting appropriate data, configurations of contexts and mechanisms which 
influence the outcome of QCs within each study will be identified. Studies will be grouped by similar propositional 
statements in order to identify patterns and validation from stakeholders sought. Finally, theories will be explored in 
order to explain these patterns and to help stakeholders maintain and improve QC performance. 

Discussion: Analyzing context-mechanism-outcome (CMO) patterns will reveal how QCs work and how contextual 
factors interact to influence their outcome. The aim is to investigate unique configurations that enable them to 
improve the performance of health care professionals. Using a standardized reporting system, this realist review will 
allow the research questions to be answered to the satisfaction of key stakeholders and enable on-going critical 
examination and dissemination of the findings. 

Study registration: PROSPERO registration number: CRD4201 3004826. 

Keywords: Realist synthesis. Realist review. Quality circle. Peer review group. Small group work. Quality improvement 



Background 

Rationale for the review 

Quality circles (QCs) are small groups of 6 to 12 profes- 
sionals from a similar background who meet at regular 
intervals to discuss and review their clinical practice. 
The focus of discussion is usually a critical evaluation of 
a key issue related to quality in health care. QCs select 
the issues they want to deal with themselves, decide on 
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their method of gathering data, and determine a way of 
finding solutions to prioritized problems. Facilitators ob- 
serve and lead the group through the circle of quality 
improvement [1-8]. The main purposes of QCs in primary 
health care are continuing professional development 
(CPD), quality improvement, and continuing medical 
education (CME) [3,9-13]. 

QCs have been established predominantly in Germany, 
Switzerland, Austria, Sweden, Denmark, Norway, Belgium, 
France, the Netherlands, and Ireland [14]. In Switzerland, 
they have been established as the main method of qua- 
lity improvement and CPD and, currently, 80% of all 
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physicians working in primary health care regularly at- 
tend QCs [15]. 

Numerous studies suggest that QCs improve individ- 
ual and group performance in terms of costs, ordering 
of tests, prescription habits, and adherence to clinical 
practice guidelines, thus resulting in better patient out- 
come measures and changes in performance indicators 
[6,8,16-22]. Several systematic reviews (SRs) in the 
Cochrane Library show that elements of QCs such as 
educational materials, workshops, audit and feedback 
(with or without outreach visits), and local knowledge 
experts have a positive impact on the behavior of practi- 
tioners [23-27]. Facilitation is a key factor that has been 
shown in several reviews to be effective [28,29]. Al- 
though systematic reviews of QCs provide summaries of 
their effectiveness, they are based on the assumption 
that the intervention has causal powers, and are typically 
unable to explain considerable variations in effectiveness 
because the original trials that are included in the review 
rarely explore the influence of surrounding contexts 
effectiveness [30]. 

Stakeholders in Switzerland, including practitioners, 
networks of health care centers, professional associations, 
and health insurance companies, largely recognize that 
QCs are effective but they have difficulty generalizing the 
results with confidence. They believe that QCs provide a 
social context for reflective practice and allow the disse- 
mination of knowledge to influence the work practices of 
the participants. While stakeholders agree about the con- 
text and broad range of internal mechanisms, they are not 
confident in understanding how the active components of 
QCs prompt physicians to change their behavior [31]. 

QCs have all the properties of complex interventions. 
Complex interventions depend on human behavior and 
their active ingredients tend to enable people to do the 
right thing at the right time or constrain them from 
doing something. They combine numerous and varying 
components and they function in diverse contexts. Indi- 
vidually, QCs respond to the unique constellation of the 
local needs of the complex system of primary health 
care. They are also responsive to changes in prevailing 
economic and cultural circumstances [32,33]. 

For these reasons, a realist review is necessary to ex- 
plore how local context interacts with various mecha- 
nisms to produce more or less effective QCs [34-36]. 
Further, a realist review can produce important informa- 
tion about the relative effectiveness of various compo- 
nents, thereby enabling stakeholders and practitioners to 
make informed decisions about the best structure and 
process for their particular QCs. 

Objectives and focus of the review 

The primary aim of this synthesis is to explain the 
QC program by finding underlying program theories. 



reviewing how the theories are tested within studies, and 
comparing context-mechanism-outcome (CMO) config- 
urations across studies to produce a middle-range theory 
explaining why, how, and when QCs work, over what 
time frame, and in what circumstances. The range of 
components that characterize QCs, their underlying 
mechanisms, and the local context in which QCs are 
conducted will be documented. The patterns within 
QCs, in which components act both independently and 
inter-dependently, will be investigated and mapped in 
relation to variations in underlying mechanisms and the 
local context. Study outcomes will be evaluated to iden- 
tify optimal conditions for success, which will then in- 
form stakeholders about strategies to manage and 
maintain current QCs. 

Review questions 

1) How do configurations of components and their 
underlying mechanisms within QCs influence their 
outcomes? 

2) How do contextual features surrounding QCs 
improve individual and/or group performance? 

Methods 

This protocol sets out the scope for the realist review, 
describes the initial program theory for QCs and rele- 
vant candidate theories, outlines the search strategy and 
process for sifting abstracts on the topic of interest, and 
proposes a theory-based framework for extracting data. 
Overall approaches to data analysis and synthesis are 
outlined, with the condition that, as with all realist re- 
views, the approaches are tailored to ensure they are ap- 
propriate for the available data. 

Identifying candidate theories 

We initially explored the QC program theory using a 
scoping review of published papers and grey literature 
together with discussions with stakeholders [2,37-40]. By 
using terms such as quality circle' in the title and the 
abstract in Ovid MEDLINE and Embase, examining trai- 
ning material used in Switzerland, Austria and Germany, 
and studying the background literature used by stake- 
holders, the scoping review revealed a number of key ele- 
ments that may facilitate QCs [4,5,41-44]. 

QCs are assumed to work because they bring people 
together to identify key issues concerning the quality of 
health care and they involve people in exploring solu- 
tions where there is a need for improvement. Coming 
from similar backgrounds, meeting in small groups at 
regular intervals, and, perhaps, voluntary participation 
are basic properties of QCs. It also seems to be impor- 
tant to have a trained facilitator who can engage the 
individuals and groups, support autonomy in terms of 
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selection of the issue and the approach for reviewing 
information, and find solutions [3]. Communication tech- 
niques such as debate, consensus discussion, brainstor- 
ming, reflective thinking, self-observation, and role play 
among other practices appear to keep QCs active. Educa- 
tional strategies such as audit and feedback, outreach 
visits, workshop-like atmosphere, and use of local opinion 
leaders are regularly brought into play [45,46]. Results of 
QCs include improved patient outcomes measured in 
changes of performance indicators and cost benefits [47]. 

After informal discussions with stakeholders from 
Switzerland and other European countries where QCs 
are prevalent, a set of questions was used to guide inter- 
views with QC participants, facilitators, mentors, and 
regulators in Switzerland. These interviews clarified the 
objectives and the focus of QCs and confirmed that 
stakeholders have a common understanding of this im- 
portant program. Stakeholders believe that QCs work 
because groups provide a social context for reflective 
practice and allow the dissemination of the findings to 
the participants' working places, especially if they are 
embedded in a wider system. This has provided the im- 
petus for this review. 

Search for data 

An initial scoping search was performed to clarify the 
historical development of QCs, establish time frames, 
and describe their geographical distribution. The terms 
peer review group' (PRC), quality circle' (QC), and small 
group work' (SGW) were all included in the search 
as these terms are used interchangeably in different 
European countries. A Web of Knowledge citation map 
was used to identify the earliest published paper in 1979. 
Therefore, this search begins in 1980 using MEDLINE, 
Embase, PsycINFO, and CINHAL databases without lan- 
guage restrictions [48-51]. A comprehensive but purposive 
search for literature will be conducted using search strings 
for terms related to the descriptors of QC program theory, 
quality improvement, group functions and facilitation, and 
primary health care [Additional file 1]. In collaboration 
with a librarian, we developed a strategy that was guided 
by a selected set of documents [Additional file 2] [52]. At 
all stages, snowball strategies and access to the grey litera- 
ture will be used. Authors will be contacted to clarify data 
when necessary. An iterative search may be necessary if 
new prospective theories are identified during data ana- 
lysis. Results of stakeholder discussions, interviews, and 
consultations as well as training and conference material 
will serve as data. 

Selection of studies 

Criteria for identifying relevant studies and appraising 
study designs have been piloted using a subset of rele- 
vant articles about the QCs identified during the scoping 



search. The two sifting questions for identifying relevant 
studies and papers will be: 

1) Does the study describe QCs that take place in a 
primary health care setting? 

2) Does the study describe QCs that include structured 
SGW including a facilitator? 

These questions identify appropriate examples of QCs 
in the setting of primary health care. When both ques- 
tions can be answered in the affirmative, the next step 
will be to identify appropriate quantitative papers that 
provide an adequate description of the evaluation me- 
thods and outcomes together with appropriate qualita- 
tive studies that provide descriptions and explanations of 
the key elements in the preliminary program theory. 

Appropriate studies will be selected by asking: 

1) Does the study provide details about the tools and 
outcomes of evaluation? Or 

2) Does the study provide qualitative data on the 
context in which the QC takes place? Or 

3) Does the study present qualitative data on QC group 
dynamics or facilitation? Or 

4) Does the study contain qualitative data on QCs and 
social learning, adult learning, learning techniques, 
or behavioral change theories? 

Quality assessment of the studies will focus on de- 
termining relevance and credibility in relation to the 
research question and how the findings relate to the 
context of the study [34]. Reasons why papers are in- 
cluded or excluded will be documented. 

Data extraction and analysis 

Data will be extracted as text and quantitative summa- 
ries to describe the configuration of mechanisms, con- 
text, and outcomes for each study. Author discussions of 
reasons for QC successes or failures will be included as 
data. Where studies have explicitly used a program the- 
ory, the theory will be noted. 

In the first stage of analysis, context components will 
be extracted together with descriptions of mechanisms 
on a study-by-study basis. The configuration within each 
study will be identified; that is, how context interacts with 
mechanisms to either enable or constrain QCs. Proposi- 
tions will be developed for each study describing the rela- 
tionship between context, mechanism, and outcome [53]. 

In the second stage of analysis, studies will be grouped 
by similar propositional statements in order to iden- 
tify patterns in an iterative process. For example, QCs 
that occur in similar contexts could be compared to 
see if these similar contexts consistently trigger the 
same mechanisms. Likewise, QCs that focus on the same 
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mechanisms will also be compared across different con- 
texts to examine if these mechanisms are consistent in 
terms of producing similar outcomes. Differences in con- 
texts and configurations of components will be high- 
lighted in which the underlying mechanisms can either be 
constraining or enabling. These demi-regularities will be 
presented as statements of which types of QC work, in 
which local contexts and circumstances, for which type 
of practitioner, and at which points in time. Swiss and 
European stakeholders have declared an interest in assist- 
ing with building these propositional statements as experts 
in local contexts. At the third stage of analysis, middle- 
range theories will be explored in order to explain the 
visible and hidden forces behind the demi-regularities. 
Our consultation with stakeholders and reviews of training 
material suggested that we may find explanatory theories 
from psychological, social, or economic sciences that offer 
some explanation about the complex social interactions 
within a QC. The search on theories has revealed three dif- 
ferent theoretical fields focusing on factors that influence 
professional behavior change: 1) theories of adult learning, 
social learning, and problem-based learning, which can be 
used to explain improvement in observed practice and 
changes in physician behavior [54,55]; 2) theories on indi- 
vidual practitioner behavior change, which can be mapped 
to general domains of behavior change [56]; and 3) theo- 
ries related to implementation research in health settings 
and translating knowledge into action [57,58]. 

Over the past ten years, the theoretical domains that 
influence practitioner behavior change have been sys- 
tematically identified [59,60]. The Theoretical Domains 
Framework (TDF) was developed as a theory-based clas- 
sification of terms labeling behavior change across 14 
key explanatory domains [61]. Several SRs and rando- 
mized studies have demonstrated that using theoretical 
domains helps to identify relevant theories to explain 
clinical practice and problems with implementation 
[62-64]. For this review, the TDF wiU be used as an ini- 
tial organizing framework for categorizing the process of 
behavior change across QCs. It is recognized that most 
realist reviews aim to identify potential middle-range 
theories at an early stage of the review, but the scoping 
revealed a diversity in terms of types of theories. There- 
fore, we have chosen the approach used by Jagosh et al, 
(2013) of first sorting the literature and then immersion 
in the data, at which stage a considered approach can be 
taken to reviewing goodness of fit with the theoretical 
areas identified during preliminary theory scoping [65]. 

We will explore whether the configurations pro- 
duced from our QC data can be mapped to three re- 
cently published theoretical frameworks: Promoting 
Action on Research Implementation in Health Servi- 
ces (PARiHS) framework, behavior change wheel (BCW), 
and knowledge-to-action cycle (KTAC) [56,66,67]. The 



PARiHS framework suggests that successful implementa- 
tion requires an analysis of the nature and type of know- 
ledge and the qualities of the local context. This analysis 
determines the type of facilitation that is needed to make 
the change successful. The BCW targets the necessary 
interacting conditions for individuals in a QC to start 
acting, by focusing on their capability, opportunity, and 
motivation. These conditions will boost the KTAC by fa- 
cilitating individuals within the group to increase their 
capability and motivation after establishing favorable pre- 
conditions within QCs, depending on the type of know- 
ledge gap. Using these three theoretical frameworks, a 
conceptual framework was developed for this review to 
allow the comparison of different theories, in a structure 
that is independent of their origin. This will be used for 
describing the core components of QCs, mapping the way 
in which they relate to each other, and for seeking possible 
reasons for these relationships (Figure 1). 

Data synthesis 

We aim to synthesize the findings so that they are of use 
to practitioners when designing or modifying QCs. The 
stakeholders' main interest in a realist review lies in 
learning more about which ingredients lead to better 
outcomes and lower costs and which contexts are neces- 
sary to achieve these goals over a longer period of time. 
Fine-tuning the synthesis of theories underlying each of 
the original review questions should provide stakeholders 
with relevant answers [34,53,68]. 

Theories in comparative settings will reveal which 
contextual features are of importance. Questioning pro- 
gram integrity will reveal which combinations of con- 
texts or interventions at different levels, be it group, 
organization, or primary health care, wiU support the 
QC process. The assessment of rival program theories 
wiU identify middle-range theories and demi-regularities 
that can optimize QC performance. This wiU result in 
specific recommendations of optimal variations to the 
program in specific contexts, thus enabling stakeholders 
to implement successful patterns of contextual features 
and effective QC components [53]. 

Reporting and dissemination of the findings 

Transparent reporting of the process and findings is im- 
portant for creating an audit trail. The standards of rea- 
list and meta-narrative evidence synthesis (RAMESES) 
provide publication criteria for a review of this type [69]. 
The authors wiU foUow the RAMESES statement as they 
explore and answer the research questions in language 
acceptable to all stakeholders. An academic article wiU 
be written for publication in an international journal 
specializing in implementation. Findings will be dis- 
seminated through consultations with stakeholders in 
Switzerland, who will be able to critically evaluate the 
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Figure 1 Theoretical frameworlc. Center: group, group facilitation, and type of l<nowledge to be put into practice, representing tine action cycle 
engine (PARiHS). Green triangle: interaction between motivation, opportunity, and capability, resulting in appropriate behavior for change (BCW). 
Green circle: knowledge-to-action cycle (KTAC). Red circle: intervention functions (BCW). Dark blue circle: policy categories (BCW). Blue circle: 
context factors on several levels of the program. BCW, behavior change wheel; HTAC, knowledge-to-action cycle; PARiHS, Promoting Action on 
Research Implementation in Health Services. 



results and then, ultimately, implement them. Further, 
the results of the review will be presented at the meeting 
of the European Society for Quality and Safety in Family 
Practice (EQuiP) in 2015. This will allow European stake- 
holders to evaluate current practice and discuss further 
steps for enhancing QCs across Europe. 

Trial status 

The authors have already completed the protocol, and 
plan in December 2013 to start the review, which has been 
registered with PROSPERO, the international prospective 
register of systematic reviews: CRD42013004826. 

Discussion 

Ethical issues 

A review of this kind does not require approval from an 
ethics committee because it is not primary research. 
However, it will follow the relevant standards of utility, 
usefulness, feasibility, propriety, accuracy, and accoun- 
tability [70,71]. 

Limitations 

This realist review has two major limitations. Firstly, 
it is dependent on the transparency and adequacy of 



reporting by original authors. To address this, authors 
will be contacted for clarification and related reports 
will be examined. Additionally, there is the risk of the 
selective bias of choosing underlying theories and syn- 
thesizing them in an ad hoc manner. This will be ad- 
dressed through the creation of an overarching framework 
to guide systematic theory development and through an 
iterative process of communication with the stakeholders 
and consultation of the literature. 

Summary 

Realist synthesis is a methodology under development 
and this protocol makes explicit the processes of using 
stakeholders as a key source of information to clarify the 
scope of the review. We developed separate search stra- 
tegies for understanding the scope, finding underlying 
theories, and identifying primary studies. We explicitly 
described the data extraction and analysis process 
across three levels of investigation, and have planned 
the final stage of synthesizing data and drawing of con- 
clusions for theory development. The stakeholders will 
receive on-going reports for checking and ensuring 
policy relevance and for safeguarding future policy 
development. 
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Additional files 



Additional file 1: Program', 'quality improvement', 'group', and 
'primary care' terms. 

Additional file 2: Search strategy in Ovid MEDLINE, Embase, and 
PsyclNFO. 



Abbreviations 

BCW: Behavior change wheel; CME: Continuing medical education; 
CMO: Context-mechanism-outcome; CPD: Continuing professional 
development; EQuiP: European Society for Quality and Safety in Family 
Practice; l<TAC: Knowledge-to-action cycle; PARiHS: Promoting action on 
research implementation in health services; PRG: Peer review group; 
QC: Quality circle; RAMESES: Realist and meta-narrative evidence synthesis; 
SGW: Small group work; SR: Systematic review; TDF: Theoretical domains 
framework. 

Competing interests 

There are no financial conflicts. As a member of the committee of quality in 
Swiss family practices and a supervisor and trainer of facilitators working at 
santemed Health Care Centres, a network providing primary health care 
services, AR has great personal expertise and many years' experience of QCs. 
SM and JH contribute independently to this project from their academic and 
methodological experience. 

Authors' contributions 

AR performed the conceptual work and prepared the protocol as part of 
formal postgraduate study (DPhil Programme in Evidence-Based Health Care, 
University of Oxford, Oxford, UK). SM supervised the development of the 
protocol, critically reviewed the text, and assisted with editing. JH provided 
important input regarding the methodology and revised the protocol 
with regard to the realist approach. All authors read and approved the 
final manuscript. 

Authors' information 

AR: DPhil, Department of Primary Health Care Sciences, University of Oxford, 
Oxford, UK; santemed Health Care Centres; member of EQuiP; and delegate 
for Quality in Medicine on behalf of the Swiss Association of Family 
Medicine. SM: Senior Researcher, Centre for Evidence Based Medicine, 
Department of Primary Health Care Sciences, University of Oxford, Oxford, 
UK. JH: Senior Lecturer and Course Director, MPH in International Health 
Management and Leadership, School of Health and Related Research 
(ScHARR), University of Sheffield, Sheffield, UK; and Co-Convenor, Cochrane 
Qualitative Research Methods Group. 

Acknowledgement 

Nia Roberts at the Department of Primary Health Care Sciences, Bodleian 
Libraries, University of Oxford, has contributed substantially to the search 
strategy of this work. 

Funding 

This paper was written without any funding as part of AR's DPhil studies at 
the Department of Primary Health Care Sciences, University of Oxford. 

Author details 

^santemed Health Care Centre, Friedtalweg 18, Wil 9500, Switzerland. 
^Department of Primary Health Care Sciences, University of Oxford, New 
Radcliffe House, Walton Street, Jericho, Oxford 0X2 6NW, UK. ^Section of 
Public Health, School of Health and Related Research (ScHARR), University of 
Sheffield, Regent Court, 30 Regent Street, Sheffield SI 4DA, UK. 

Received: 8 July 2013 Accepted: 25 November 2013 
Published: 9 December 2013 

References 

1 . Ishikawa K: How to Operate QC Circle Activities. Tokyo: QC Circle 
Headquarters, Union of Japanese Scientists and Engineers; 1985. 

2. Qualitatszirkel. http://www.kbv.de/themen/qualitaetszirkel.html. 



3. Tutorengruppe fur die Ausbildung von Qualitatszirkel-Moderatoren: 
Definition medizinischer Qualitatszirl<el - ein Vernehmlassungstext. 
Prim Care 2005, 5(16):370-372. 

4. Grol R, Lawrence M: Quality Improvement by Peer Review. Oxford: Oxford 
University Press; 1995. 

5. Tross 0: Qualitatszirkel als Form der Arbeitsorganisation: Planung and 
Gestaltung von Qualitatszirkelnals Variante der Teamarbeit in Unternehmen. 
Munich: GRIN Verlag; 2003. 

6. Verstappen WH, van Merode F, Grimshaw J, Dubois Wl, Grol RP, van der 
Weijden T: Comparing cost effects of two quality strategies to improve 
test ordering in primary care: a randomized trial. Int J Qual Health Care 
2004, 16(5):391-398. 

7. Watkins C, Timm A, Gooberman-Hill R, Harvey I, Haines A, Donovan J: Factors 
affecting feasibility and acceptability of a practice-based educational 
intervention to support evidence-based prescribing: a qualitative study. 
Fam Pract 2004, 21 (6):661 -669. 

8. Wensing M, Broge B, Riens B, Kaufmann-Kolle P, Akkermans R, Grol R, 
Szecsenyi J: Quality circles to improve prescribing of primary care 
physicians. Three comparative studies. Pharmacoepidemiol Drug Saf 2009, 
18(9):763-769. 

9. Grol R, Baker R, Wensing M, Jacobs A: Quality assurance in general 
practice: the state of the art in Europe. Fam Pract 1 994, 1 1 (4):460-467. 

10. Gerlach FM, Beyer M, Romer A: Quality circles in ambulatory care: state of 
development and future perspective in Germany. Int J Qual Health Care 
1998, 10(1):35-42. 

11. Ennis K, Harrington D: Quality management in Irish health care. Int J 

Health Care Qual Assur Inc Leadersh Health Serv 1999, 12(6-7):232-243. 

12. O'Riordan M: Continuing medical education in Irish general practice. 
ScandJ Prim Health Care 2000, 18(3):137-138. 

13. Munck A, Damsgaard J, Hansen DG, Bjerrum L, Sondergaard J: The Nordic 
method for quality improvement in general practice. Qual Prim Care 
2003, 11(1 ):73-78. 

14. Beyer M, Gerlach FM, Flies U, Grol R, Krol Z, Munck A, Olesen F, O'Riordan M, 
Seuntjens L, Szecsenyi J: The development of quality circles/peer review 
groups as a method of quality improvement in Europe. Results of a 
survey in 26 European countries. Fam Pract 2003, 20(4):443-451. 

15. Meyer-Nikolic VA, Hersperger M: Qualitatsentwicklung in der ambulanten 
Medizin CH: Q-Monitoring-Resultate schaffen Ubersicht. Schweizerische 
Arztezeitung 2012, 93:1036-1038. 

16. Verstappen WH, van der Weijden T, Sijbrandij J, Smeele I, Hermsen J, 
Grimshaw J, Grol RP: Effect of a practice-based strategy on test ordering 
performance of primary care physicians: a randomized trial. JAMA 2003, 
289(18):2407-2412. 

17. Verstappen WH, van der Weijden T, Dubois Wl, Smeele I, Hermsen J, Tan FE, 
Grol RP: Improving test ordering in primary care: the added value of a 
small-group quality improvement strategy compared with classic 
feedback only. Ann Fam Med 2004, 2(6):569-575. 

18. Niquille A, Ruggli M, Buchmann M, Jordan D, Bugnon 0: The nine-year 
sustained cost-containment impact of Swiss pilot physicians-pharmacists 
quality circles. Ann Pharmacother 2008, 44(4):650-657. 

19. Welschen I, Kuyvenhoven MM, Hoes AW, Verheij TJ: Effectiveness of a 
multiple intervention to reduce antibiotic prescribing for respiratory 
tract symptoms in primary care: randomised controlled trial. BMJ 2004, 
329(7463):431. 

20. Stevenson K, Baker R, Farooqi A, Sorrie R, Khunti K: Features of primary 
health care teams associated with successful quality improvement of 
diabetes care: a qualitative study. Fam Pract 2001, 18(1):21-26. 

21. Schneider A, Wensing M, Biessecker K, Quinzler R, Kaufmann-Kolle P, 
Szecsenyi J: Impact of quality circles for improvement of asthma care: 
results of a randomized controlled trial. J Eval Clin Pract 2008, 
14(2):185-190. 

22. Bugnon 0, Jotterand S, Niquille Charriere A, Ruggli M, Herzig L: 
Physicians-pharmacists quality circles: shared responsibility of the 
freedom of prescription. Rev Med Suisse 2012, 8(341 ):1 044-1 048. 1042. 

23. O'Brien M, Rogers S, Jamtvedt G, Oxman Andrew D, Odgaard-Jensen J, 
Kristoffersen Doris T, Forsetlund L, Bainbridge D, Freemantle N, Davis DA, 
Haynes RB, Harvey EL: Educational outreach visits: effects on professional 
practice and health care outcomes. Cochrane Database Syst Rev 2007, 
4:CD000409. 

24. Forsetlund L, Bjorndal A, Rashidian A, Jamtvedt G, O'Brien MA, Wolf F, 
Davis D, Odgaard-Jensen J, Oxman AD: Continuing education meetings 



Rohrbasser et al. Systematic Reviews 2013, 2:1 10 
http://www.systennaticreviewsjournal.conn/content/2/1/1 10 



Page 7 of 7 



and workshops: effects on professional practice and health care 
outcomes. Cochrane Database Syst Rev 2009, 2:CD003030. 

25. Baker R, Camosso-Stefinovic J, Gillies C, Shaw Elizabeth J, Cheater F, Flottorp 
S, Robertson N: Tailored interventions to overcome identified barriers to 
change: effects on professional practice and health care outcomes. 
Cochrane Database Syst Rev 2010, 3:CD005470. 

26. Flodgren G, Parmelli E, Doumit G, Gattellari M, O'Brien Mary A, Grimshaw J, 
Eccles Martin P: Local opinion leaders: effects on professional practice 
and health care outcomes. Cochrane Database Syst Rev 201 1, 8:CD000125. 

27. Ivers N, Jamtvedt G, Flottorp S, Young Jane M, Odgaard-Jensen J, French 
Simon D, O'Brien Mary A, Johansen M, Grimshaw J, Oxman Andrew D: Audit 
and feedback: effects on professional practice and healthcare outcomes. 
Cochrane Database Syst Rev 201 2, 6:CD000259. 

28. Dogherty EJ, Harrison MB, Graham ID: Facilitation as a role and process in 
achieving evidence-based practice in nursing: a focused review of 
concept and meaning. Worldviews Evid Based Nurs 2010, 7(2):76-89. 

29. Baskerville NB, Liddy C, Hogg W: Systematic review and meta-analysis of 
practice facilitation within primary care settings. Ann Fam Med 2012, 
10(l):63-74. 

30. Shepperd S, Lewin S, Straus S, Clarke M, Eccles MP, Fitzpatrick R, Wong G, 
Sheikh A: Can we systematically review studies that evaluate complex 
interventions? PLoS Med 2009, 6 (8) :e 1000086. 

31. Campbell NC, Murray E, Darbyshire J, Emery J, Farmer A, Griffiths F, Guthrie 
B, Lester H, Wilson P, Kinmonth AL: Designing and evaluating complex 
interventions to improve health care. BMJ 2007, 334(7591 ):455-459. 

32. Rickles D, Hawe P, Shiell A: A simple guide to chaos and complexity. 
J Epidemiol Community Health 2007, 61 (1 1):933-937. 

33. Shiell A, Hawe P, Gold L: Complex interventions or complex 
systems? Implications for health economic evaluation. BMJ 2008, 
336(7656):1 281 -1283. 

34. Pawson R, Greenhalg T, Haervey G, Walshe K: Realist synthesis: an 
introduction. In Research Methods: An ESRC Research Programme. 
Manchester: ESRC Research Methods Programme, University of Manchester; 
2004. 

35. Rycroft-Malone J, McCormack B, Hutchinson A, DeCorby K, Bucknall T, 
Kent B, Schultz A, Snelgrove-Clarke E, Stetler C, Titler M, Wallin L, Wilson V: 
Realist synthesis: illustrating the method for implementation research. 
Implement Sci 20)2, 7(1):33. 

36. Astbury B, Leeuw FL: Unpacking black boxes: mechanisms and theory 
building in evaluation. Am J Eval 201 0, 31 (3):363-381 . 

37. Leeuw FL: Reconstructing program theories: methods available and 
problems to be solved. Am J Eval 2003, 24(l):5-20. 

38. Qualitatszirkel. http://www.sgam.ch/arbeitsgruppen/fortbildung-und-qf/ 
qualitaetszirkel.html. 

39. Die Argomed-Qualitatszirkel. http://www.argomed.ch/qualitaetszirkel.html. 

40. Qualitatszirkel. http://www.oegam.at/wissenschaft-publikationen/ 
qualitaetssicherung/qualitaetszirkel/. 

41. Nicholson JAH: Quality circles and participative management. Farm 
Manag 1987, 6(8):335-341. 

42. Langmaak B, Braune-Krickau M: Wie die Gruppe laufen lernte. Berlitz Verlag: 
Weinheim; 1989. 

43. Gerlach FM: Quiaitdtssicherung durch hausartzliche Qualitatszirkel: Strategien 
zur Etablierung. Berlin: Ullstein Mosby; 1994. 

44. Lampe G, Szecsenyi J, Weiss-Plumeyer M: Moderatorentraining. Gottingen: 
AQUA-Verlag; 1994. 

45. Lawrence M, Schofield T: Medical Audit in Primary Health Care. Oxford: 
Oxford University Press; 1993. 

46. Marinker M: Medical Audit and General Practice. London: BMJ Publishing 
Group; 1995. 

47. Eraser R, Mayur L, Baker R: Evidence-Based Audit in General Practice. Oxford: 
Butterworth Heinemann; 1999. 

48. Rendall E: Quality circles - a 'third wave' intervention. Train Dev J 1981, 
35(3):28. 

49. Turban E, Kamin JY: Cost-benefit analysis of quality circles. Eng Costs Prod 
Econ 1984, 8(3):1 99-209. 

50. Schmele JA, Allen ME, Butler S, Gresham D: Quality circles in the public 
health sector: implementation and effect. Public Health Nurs 1991, 
8(3):190-195. 

51. Bilawka E, Craig BJ: Quality assurance in health care: past, present and 

future. Int J Dent Hyg 2003, 1 (3):1 59-1 68. 



52. McMahon T, Ward PR: HIV among immigrants living in high-income 
countries: a realist review of evidence to guide targeted approaches to 
behavioural HIV prevention. Syst Rev 2012, 1:56. 

53. Pawson R: Evidence Based Policy: A Realist Perspective. London: SAGE; 2006. 

54. Principles of Adult Learning, http://www.qotfc.edu. a u/resource/?page=65 3 75. 

55. Elwyn G, Greenhalg T, Macfarlane F: Groups: A Guide to Small Group Work in 
Healthcare, Management, Education and Research. Oxford: Radcliffe Medical 
Press; 2004. 

56. Michie S, van Stralen M, West R: The behaviour change wheel: a new 
method for characterising and designing behaviour change 
interventions. Implement Sci 201 1, 6(1):42. 

57. Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W, Robinson 
N: Lost in knowledge translation: time for a map? J Contin Educ Health 
Prof 2006, 26(1 ):1 3-24. 

58. Grimshaw JM, Schunemann HJ, Burgers J, Cruz AA, Heffner J, Metersky M, 
Cook D: Disseminating and implementing guidelines: article 13 in 
Integrating and coordinating efforts in COPD guideline development. An 
official ATS/ERS workshop report. Proc Am Thorac Soc 2012, 9(5):298-303. 

59. Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A: Making 
psychological theory useful for implementing evidence based practice: a 
consensus approach. Qual Saf Health Care 2005, 14(l):26-33. 

60. Leeman J, Baernholdt M, Sandelowski M: Developing a theory-based 
taxonomy of methods for implementing change in practice. J /\c/\/ Nurs 
2007, 58(2):191-200. 

61 . Cane J, O'Connor D, Michie S: Validation of the theoretical domains 
framework for use in behaviour change and implementation research. 
Implement Sci 20U, 7(1):37. 

62. Francis JJ, Stockton C, Eccles MP, Johnston M, Cuthbertson BH, Grimshaw 
JM, Hyde C, Tinmouth A, Stanworth SJ: Evidence-based selection of 
theories for designing behaviour change interventions: using methods 
based on theoretical construct domains to understand clinicians' blood 
transfusion behaviour. Br J Health Psychol 2009, 14(Pt 4):625-646. 

63. Group A, McSherry L, Dombrowski S, Francis J, Murphy J, Martin C, O'Leary 
J, Sharp L: 'It's a can of worms': understanding primary care practitioners' 
behaviours in relation to HPV using the theoretical domains framework. 
Implement Sci 20U, 7(1):73. 

64. Francis J, O'Connor D, Curran J: Theories of behaviour change synthesised 
into a set of theoretical groupings: introducing a thematic series on the 
theoretical domains framework. Implement Sci 2012, 7(1):35. 

65. Jagosh J, Pluye P, Wong G, Cargo M, Salsberg J, Bush PL, Herbert CP, Green 
LW, Green ha Igh T, Macau lay AC: Critical reflections on realist review: insights 
from customizing the methodology to the needs of participatory research 
assessment Methods: Res Synth; 2013. doi: 10.1002/jrsm.l099. 

66. Kitson A, Rycroft-Malone J, Harvey G, McCormack B, Seers K, Titchen A: 
Evaluating the successful implementation of evidence into practice 
using the PARiHS framework: theoretical and practical challenges. 
/mp/emenrSc/2008, 3(1):1. 

67. Straus SE, Tetroe J, Graham I: Defining knowledge translation. Can Med 
Assoc J 2009, 181(3-4):165-168. 

68. Greenhaigh T, Wong G, Westhorp G, Pawson R: Protocol-realist and 
meta-narrative evidence synthesis: evolving standards (RAMESES). BMC 
Med Res Methodol 2011, 11(1):115. 

69. Wong G, Greenhaigh T, Westhorp G, Buckingham J, Pawson R: RAMESES 
publication standards: meta-narrative reviews. BMC Med 2013, 11(1):20. 

70. Bislimi R, Bischofberger I, Drewe J, Galeazzi R, Kesselring A, Kind C, Salathe 
M, Rehmann-Sutter C, Sprumont D: Forschung mit Menschen: ein Leitfaden 
fur die Praxis. Schwabe: Basel; 2009. 

71. Yarbrough DB, Shuiha LM, Hopson RK, Caruthers FA: The Program Evaluation 
Standards: A Guide for Evaluators and Evaluation Users. 3rd edition. Thousand 
Oaks, CA: SAGE; 2010. 



doi:1 0.1 1 86/2046-4053-2-1 1 0 

Cite this article as: Rohrbasser et al.: Exploring why quality circles work 
in primary health care: a realist review protocol. Systematic Reviews 

2013 2:110. 



